Optimazation of Traffic Light Controlling with Reinforcement Learning COMP 3211 Final Project, Group 9, Fall 2017-2018

نویسندگان

  • CHEN Ziyi
  • LI Xinran
  • LIU Cheng
چکیده

Ensuring the efficiency of transportation systems is a priority for modern society. Technological advances enable transportation system to collect huge sets of varied data on an unprecedented scale. Recent studies in combining deep neural network architectures with reinforcement learning techniques have demonstrated promising potential results in solving complex control problems with high dimensional state and action spaces. Inspired by these studies, we applied the similar idea to build a neural network architecture implemented by the reinforcement learning, where a new reward function for the traffic light control problem is implemented. Through experiment in SUMO traffic simulator, we prove that this approach could improve the efficiency of transportation system compared to the traditional controlling policy.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Deep Reinforcement Learning for Traffic Light Control in Vehicular Networks

Existing inefficient traffic light control causes numerous problems, such as long delay and waste of energy. To improve efficiency, taking real-time traffic information as an input and dynamically adjusting the traffic light duration accordingly is a must. In terms of how to dynamically adjust traffic signals’ duration, existing works either split the traffic signal into equal duration or extra...

متن کامل

Doas 2006 Project: Reinforcement Learning of Traffic Light Controllers Adapting to Accidents

Last year we started a project concerned with intelligent traffic control. Using a simulator that models urban road traffic, we developed an improved traffic light controller based on measuring traffic congestion on the roads and reinforcement learning. This year an important focus will be on dealing with traffic accidents. In this student project we want to investigate a learning traffic contr...

متن کامل

Traffic Light Control Using Deep Policy-Gradient and Value-Function Based Reinforcement Learning

Recent advances in combining deep neural network architectures with reinforcement learning techniques have shown promising potential results in solving complex control problems with high dimensional state and action spaces. Inspired by these successes, in this paper, we build two kinds of reinforcement learning algorithms: deep policy-gradient and value-function based agents which can predict t...

متن کامل

Project Design and Organization of Autonomous Systems : Intelligent Traffic Light Control

Because of the increasing density of the traffic flow in urban areas there is a need for optimal performance of traffic lights. In this paper we will describe an existing approach of reinforcement learning applied to the optimization of traffic light configurations, and introduce a new approach. Our approach uses implicit cooperation between traffic lights, letting cars take into account the tr...

متن کامل

Feedback Control of Traffic Signal Network of Less Traffic Sensors by Help of Machine Learning

As a way of resolving vehicle congestion, there is a feedback control approach which models a traffic network as a discrete dynamical system and derives feedback gain for controlling green light times of each junction. Since the input is the sensory observed traffic flow of each link, and since the state equation models both the topology and the parameters of the network, it is effective for ad...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017